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The subgroup PSL 2 (M) is spherical in the group of 
difFeomorphisms of the circle 

Yury A. NeretiinQ 

We show that the group PSL2(R) is a spherical subgroup in the group of C 3 - 
diffeomorphisms of the circle. Also, the group of automorphisms of a Bruhat-Tits tree 
is a spherical subgroup in the group of hierarchomorphisms of the tree. 

1. Sphericity. Let G be a topological group, K be a subgroup. An 
irreducible unitary representation p of G in a Hilbert space H is called spherical 
if there is a unique up to a scalar factor non-zero A'-invariant vector v in H . 
The matrix element 

$(3) == (p(g)v,v) 

is called a spherical function on G. A subgroup K in G is called spherical if 
for any irreducible unitary representation of G the dimension of the space of 
A-invariant vectors is ^ 1. 

For various types of spherical pairs in this sense, see 0 , 0 , ns, 0 , nn, ini- 
For all known examples the group I\ is compact or is an infinite-dimensional 
analog of compact groups as U(oo), O(oo), Sp(oo), S(oo) etc. (’heavy groups’ 
in the sense of Ha)- 

2. Statements. Let SL 2 (R) be the group of 2 x 2 real matrices with 
determinant 1, let PSL 2 (R) be its quotient with respect to the center, SL 2 (R)~ 
be the universal covering group. Denote by Diff (respectively by Diff 3 ) the group 
of C^-smooth (resp. C 3 -smooth) orientation preserving diffeomorphisms of the 
circle. Denote by Diff~ the universal covering of Diff, we realize Diff~ as the 
group of smooth diffeomorphisms q of the line R satisfying the condition 

q(ip + 27r) = q(tp) + 2n. 

The Bott cocycle c{q\ 1 q 2 ) on Diff~ is defined by the formula 

c(qi,qz)= In q'l (<?2 (<p)d In q' 2 (<p) ■ 

Jo 

Consider the central extension Diff of Diff~ determined by the Bott cocycle 

-3 3 

(see, e.g., a, §3.4). By Diff we denote the similar central extension of Diff . 

Theorem 1 The subgroup PSL 2 (R) is spherical in the group Diff 3 . 


Theorem 2 


The subgroup PSL^(R) is spherical in the group Diff 
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Remark, a) Several series of spherical representations of Diff and Diff~ 
were constructed in DU, see also [13j, §IX.6. All such spherical representations 
are continuous in the C 3 -topology. 

1 Supported by the grant FWF, Project P25142 
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b) Sobolev diffeomorphisms of the circle of the class s > 3/2 form a group 
(see [7], Theorem 1.2 and Appendix B). Our proof survives for the group of 
Sobolev diffeomorphisms of the class H 45 . 13. 

Next, consider a combinatorial analog of Diff. Fix an integer n ^ 2. Consider 
the Bruhat-Tits tree T n , i.e., the infinite tree such that each vertex is incident 
ton+1 edges. Let Abs(T„) be its boundary (for detailed definitions, see, e.g., 
[17], [12]). Denote by Aut(T„) the group of all automorphisms of the graph 
T n . It is a locally compact group, stabilizers of finite subtrees form a base of 
open-closed neighborhoods of unit. 

Denote by Vert(T„) the set of vertices of T„. Consider a bijection 9 : 
Vert(T„) —> Vert (T n ) such that for all but a finite numbers of pairs of adja¬ 
cent vertices (a, b), vertices 9(a), 9(b) are adjacent. Hierarchomorphism of the 
tree T n is are homeomorphisms of Abs(T n ) induced by such maps, see [T2], [HJ. 
Denote by Hier(T ra ) the group of all hierarchomorphisms of the tree T n . 

Remark, a) For a prime n = p the boundary Abs(T p ) can be identified 
with a p-adic projective line. The group Aut(T p ) contains the p-adic PSL 2 and 
the representation theory of Aut(T p ) is similar to the representation theory of 
p-adic and real SL 2 (see j2], [17]). The group Hier(T p ) contains the group of 
locally analytic diffeomorphisms of the p-adic projective line. 

b) Richard Thompson groups (see {T]) are discrete subgroups of Hier(T„). 

c) Several series of Aut(T n )-spherical representations of Hier(T n ) were con¬ 
structed in m, m a 

We define a topology on the group Hier(T„) assuming that Aut(T n ) is an 
open subgroup (the coset space Hier(T„)/Aut(T ra ) is countable). 

Theorem 3 The subgroup Aut(T p ) is spherical in Hier(T p ). 

Theorem 4 Let G D K be a spherical pair. Assume that K does not admit 
nontrivial finite-dimensional unitary representations. Let $i(p), $2 (g) be K- 
spherical functions on G. Then <f>i(g)<f> 2 (g) is a spherical function. 

The both K = SL 2 (R)~ and Aut(T„) satisfy this condition. 

3. Proof of Theorem 1. Fix a point a in the circle. Denote by Go C Diff 
the group of diffeomorplisims q such that q(x) = x in a neighborhood of a. By 
G* we denote the group of diffeomorphisms that are flat at a, i.e., 

q(a) = a, q'(a) = 1, q"(a) = q'"(a) = ■ ■ ■ = 0 

Let p be an irreducible unitary representation of Diff in H . Denote by V 
the subspace of all PSL 2 (R.)-fixed vectors. Let P be the operator of orthogonal 
projection on V. For h £ PSL 2 (R) we have 

Pp(h) = p(h)P = P. 


Denote 

p(g) := Pp(g)P. 
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This operator depends only on a double coset of Diff by PSL 2 (R), 

p{high 2 ) ■= p(g), hi,h 2 G PSL 2 (R). 

Lemma 5 If p is continuous in the C 3 -topology, then the operators p(g) pair¬ 
wise commute. 


PROOF. The following statement is our key argument: 

Let a sequence hj G PSL 2 (R) converges to infinitThen p(hj) weakly 
converges to P, see Howe, Moore [BJ, Theorem 5.1 (this is a general theorem for 
semisimple group, for PSL 2 (R) it can be easily verified case-by-case). 

Let us realize the circle as the real projective line RP 1 = lUoo. Without 
loss of generality we can set a = oo. Let U t {x) = x + t be a shift on R, we have 
Ut G PSL 2 (R). Consider diffeomorphisms r, q G Go ■ For sufficiently large t the 
supports of r and Ut o q o U-t are disjoint. Therefore, these diffeomorphisms 
commute. Hence, 


P(r) p(Ut) p{q) p{U - t ) = p{U t ) p{q) p{U- t ) p(r). 


Therefore, 


P p{r) p(U t ) p{q) P = Pp{q) p(U- t ) p{r) P. 


Passing to a weak limit as t —> + 00 , we get 


P p(r) P p{q) P = P p(q) P p(r) P. 


Thus 

P(r) p(q) = p(q) p(r ), where r, q G G 0 . 

But Go is dense in G*. Therefore the same identity holds for r, q G G*. Indeed, 
let fj, qj G Go be sequences convergent to r, q respectively. Passing to the 
iterated limit 

lim ( lim p{rj)p(q k )) = lim ( lim p(q k )p{rj)) 

J—>00 \fc —>OO / J—too \K—>00 / 


and keeping in mind the separate weak continuity of the operator product, we 
get the desired statement. 

Our last argument: the set PSL 2 (R) • G* • PSL 2 (R) is dense in Diff with 
respect to the C 3 -topology. 

Let us prove this. Choose a coordinate on RP 1 such that a = 0. Let q G Diff. 
Consider its Schwarzian derivative, 


S(q) = 


q'q'" - f W'Y 


(q'Y 


Consider a point b such that S(q)(b) = 0 (by the Ghys theorem, the Schwarzian 
derivative of a diffeomorphisms of the circle has at least 4 zero, see tig, Theorem 
4.2.1). Then for 

r := oqoUb 

2 I.e., for any compact subset B , we have hj (fc B starting some number. 
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we have r(0) = 0, S(r)( 0) = 0. Consider maps 


such a £ PSL 2 (M) fix 0. Choosing parameters u, v, we can achieve 

(r o cr) , (0) = 1, (ro <t)"(0) = 0. 

Recall the transformation property of the Scwarzian: 

S(r o a) = ( S[r ) o a) ■ (a 1 ) 2 + S(a). 

Since a is linear fractional, S(a) = 0. Therefore S(roa) = 0, and (rocr)'"(0) = 0. 
Such ra can be approximated in G 3 -topology by elements of G*. This proves 
Lemma 5. □ 

Theorem 1 is a corollary of the lemma. Note, that p(g)* = p(g -1 ). Thus we 
get a family of commuting operators in V, such that an adjoint operator A* is 
contained in the family together with A. If dimP > 1, then this family has a 
proper invariant subspace in V, say W. Consider the Diff-cyclic span of W, i.e., 
the subspace Z spanned by vectors p(g)u> , where g £ Diff 3 and w £ W. Then 

Pp(g)w = Pp(g)Pw = p(g)w £ W. 

Hence, PZ = W and therefore Z is a proper subspace in H. 

4. Proof of Theorem 2. It repeats the previous proof with two additional 
remarks. 

1) Consider the homomorphism tt : SL 2 (R)~ —>• PSL 2 (R) ~ SL 2 (R)~/Z. We 
say that a sequence hj £ SL 2 (R)~ converges to oo if n(hj) —> oo. Then the 
Howe-More theorem remains valid. 

2) For a pair of diffeomorphisms with disjoint supports p , q the Bott cocycle 
c(q,p) vanishes, hence the diffeomorphisms p , q commute in the extended group. 

5. Proof of Theorem 3. First, there is the following analog of the Howe- 
Moore theorem: Let a sequence hj £ Aut(T n ) converges to oo. Then for any 
unitary representation p of Aut(T n ) the sequence p{hj) converges to the projec¬ 
tion to the subspace of Aut{T n )~fixed vectors, see [S]; this can be easily verified 
case-by-case starting the classification theorem of El- 

Second, fix a point a £ Abs (T n ) and denote by Go the group of hierar- 
chomorphisms that are trivial in a neighborhood of a. Let q, r £ Gq. Then 
there is a sequence hj £ Aut(T n ) fl Go such that hj tends to oo and supports of 
hjphj 1 and q are disjoint. We omit a proof, since it is easier to understand its 
self-evidence than to read a formal exposition. 

Third, 

Aut(T n ) • G 0 ■ Aut(Tji) = Hier(Tp) 

Now we can repeat the proof of Theorem 1. 

6. Proof of Theorem 4. The statement is semitrivial. 
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Lemma 6 Let u\ V 2 be unitary representations of a group T. If the tensor 
product v\ <S> V 2 contains a nonzero T-invariant vector, then the both and V 2 
have finite-dimensional subrepresentations. 

Proof of the LEMMA. Assume that an invariant vector exists. Denote 
the spaces of representations by Vi, V 2 . We identify V\ ® V 2 with the space 
of Hilbert-Schmidt operators V{ —> V 2 , where V[ is the dual space to V\. An 
invariant vector corresponds to an intertwining operator T : V[ —> V 2 . The 
operator TT* is an intertwining operator in V 2 . Since TT* is compact and 
nonzero, it has a finite-dimensional eigenspace, and this subspace is G- invariant. 
□ 

Proof of the theorem. Let p\ and P 2 be AT-spherical representations 
of G in H 1 and H 2 . Let v\, V 2 be fixed vectors. By the lemma, v\ ® V 2 is a 
unique A'-fixed vector in Hi<g>H 2 - The cyclic span W of v\ ® V 2 is an irreducible 
subreprepresentation. Indeed, let W = W\ © W 2 be reducible. Then the both 
projections of v\ <S>V 2 to W\ , W 2 are A'-fixed, therefore V\ <S>V 2 must be contained 
in one of summands, say W\ , and thus the cyclic span of Vi <S> V 2 is contained in 
W u i.e., W = Wq. 

Now we consider the representation of G in W, 

((pi(ff) ®p 2 (g))vi ® V 2 ,V! ®V 2 ) W = (pi(3)ui,Ui) ffl • {p2(g)V2,V2)H 2 

= $i(s)$ 2 (s)- 
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